Detection and Estimation of Pointing Gestures in Dense Disparity Maps
نویسندگان
چکیده
In this paper we describe a real-time system for detecting pointing gestures and estimating the direction of pointing using stereo cameras. Previously, similar systems where implemented using color-based blob trackers, which relied on effective skin color detection; this approach is sensitive to lighting changes and the clothing worn by the user. In contrast, we used a stereo system that produces dense disparity maps in real-time. Disparity maps are considerably less sensitive to lighting changes. Our system subtracts the background, analyzes the foreground pixels to break the body into parts using a robust mixture model, and estimates the direction of pointing. We have tested the system on selecting the targets in a room and controlling the cursor on a wall screen.
منابع مشابه
Dense Stereo-Based ROI Generation for Pedestrian Detection
This paper investigates the benefit of dense stereo for the ROI generation stage of a pedestrian detection system. Dense disparity maps allow an accurate estimation of the camera height, pitch angle and vertical road profile, which in turn enables a more precise specification of the areas on the ground where pedestrians are to be expected. An experimental comparison between sparse and dense ste...
متن کاملDense Disparity Estimation with a Divide-and-Conquer Disparity Space Image Technique
A new divide-and-conquer technique for disparity estimation is proposed in this paper. This technique performs feature matching following the high confidence first principle, starting with the strongest feature point in the stereo pair of scanlines. Once the first matching pair is established, the ordering constraint in disparity estimation allows the original intra-scanline matching problem to...
متن کاملOptimizing Disparity Candidates Space in Dense Stereo Matching
In this paper, a new approach for optimizing disparity candidates space is proposed for the solution of dense stereo matching problem. The main objectives of this approachare the reduction of average number of disparity candidates per pixel with low computational cost and high assurance of retaining the correct answer. These can be realized due to the effective use of multiple radial windows, i...
متن کاملCamera Arrangement in Visual 3D Systems using Iso-disparity Model to Enhance Depth Estimation Accuracy
In this paper we address the problem of automatic arrangement of cameras in a 3D system to enhance the performance of depth acquisition procedure. Lacking ground truth or a priori information, a measure of uncertainty is required to assess the quality of reconstruction. The mathematical model of iso-disparity surfaces provides an efficient way to estimate the depth estimation uncertainty which ...
متن کاملRecognition of 3D-Pointing Gestures for Human-Robot-Interaction
We present a system capable of visually detecting pointing gestures performed by a person interacting with a robot. The 3Dtrajectories of the person’s head and hands are extracted from image sequences provided by a stereo camera. We use Hidden Markov Models trained on different phases of sample pointing gestures to detect the occurrence of pointing gestures. For the estimation of pointing direc...
متن کامل